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CLAIMS 



What is claimed is; 



A method for determining accuracy of a 



classifier, comprising 
determining a set 



the steps of : 
of categories of an 
arrangement of categories selected for an item by the 
classifier ; 

determining a set of categories of the 
arrangement selected foe: the item by an authoritative 
classifier; 

determining an accuracy measure for the item 
which indicates a degree of correctness of the 
classifier based on the | categories selected by the 
classifier and the categories selected by the 
authoritative classifier. 



2 . 



The method of claim 1, wherein the step of 



determining the accuracy 
of: 



measure comprises the steps 



assigning a true indication to each category in 

the arrangement selected! by the authoritative 

classifier and assigning! a false indication to each 

category in the arrangement not selected by the 

authoritative classifier;! 

i 

assigning a positive! indication to each category 

in the arrangement selected by the classifier and 

\ 

assigning a negative indication to each category in 
the arrangement not selected by the classifier; 

determining the accuracy measure in response to 



the true, false, positive, 



and negative indications, 
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3 . The method of claim, 
determining the accuracy 
determining a true posit 
number of the categorie 



2, wherein the step of 
measure includes the step of 
ive count which indicates a 
in the arrangement assigned 



the true and positive indications. 

4. The method of claim 2, wherein the step of 
determining the accuracy measure includes the step of 
determining a false positive count which indicates a 
number of the categories in the arrangement assigned 



the false and positive 



indications . 



5. The method of claim 2, wherein the step of 
determining the accuracy measure includes the step of 
determining a false negative count which indicates a 
number of the categories in the arrangement assigned 
the false and negative indications. 

6. The method of claim 2, wherein the step of 
determining the accuracy measure includes the step of 
determining a true negative count which indicates a 
number of the categories in the arrangement assigned 
the false and negative indications. 



7 . The method of cla 
step of assigning an i 



im 2, further comprising the 



.ndifferent indication to one or 

more of the categories in the arrangement such that 

the categories with the indifferent indication do not 
contribute to the accuracy measure. 



8. The method of claim 2, wherein the step of 
determining the accurafcy measure includes the step of 
determining an indication of over-aggressiveness by 
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the classifier in resp 
positive, and negative 



i 



9 . The method of clad 
determining the accurac: 



- 19 - 

nse to the true, false, 
indications . 



m 2, wherein the step of 
y measure includes the step of 
determining an indication of over-conservativeness by 
the classifier in response to the true, false, 



positive, and negative 



indications , 



10. The method of claim 2, wherein the step of 
determining the accuracy measure includes the steps 
of: - J 

determining a true positive count which 
indicates a number of the categories in the 
arrangement assigned the true and positive 
indications 

determining a fa. 
indicates a number of 
arrangement assigned 
indications ; 

determining a fa 
indicates a number of 
arrangement assigned 
indications ; 

determining a trule negative count which 
indicates a number of j:he categories in the 
arrangement assigned the false and negative 
indications ; | 

determining an indication of over -aggressiveness 
by the classifier in response to the true , false , 
positive , and negative indications ; 



lse positive count which 

the categories in the 
the false and positive 

Lse negative count which 
the categories in the 
the false and negative 
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determining an indication of over- 



conservat iveness by t 
true, false, positive 



ne classifier in response to the 
and negative indications; 
combining the trjue positive, false positive, 
false negative, and true negative counts with the 
indications of over-aggressiveness and over- 
conser vat iveness 

11. The method of claim 1, further comprising the 
step of combining the accuracy measure with a set of 
additional accuracy measures obtained for a set of 
additional items 

12. The method of claam 1, wherein the accuracy 
measure provides a fitness measure for designing the 
classifier . 

13. " The method of claim 1, wherein the classifier 
provides a prediction of purchasing behavior and the 
accuracy measure is used to evaluate the prediction, 

14. The method of claim 1, wherein the accuracy 
measure enables a comparison of the accuracy the 
classifier with an accuracy of at least one other 
classifier . 

15. The method of claim 1, wherein the classifier is 
used in an information management system and the 
accuracy measure used to evaluate categorization of 
items in the information management system. 



16. The method of claim 1, wherein the classifier is 
used in a placement of litems in electronic portals 
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and the aocuracy measure is used to evaluate the 
placement' 
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